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The  goals  of  dus  projea  are  to  improve  aikl  extuid  our  Guided  Search  model  ci  visual 
attention  and,  in  so  doing,  to  expt^  the  general  understanding  human  visual  search 
behavior.  The  early  stages  of  visual  {xocessing  can  be  characterized  as  parallel  prowssors, 
operating  across  die  tmtire  visual  field  at  one  time.  Parallel  processing  seems  to  be  limited 
to  a  set  of  fairly  basic  properties  like  cokx*,  motion,  orientatitm,  etc.  Later  stages  in 
processing,  moating  noore  complex  perceptual  ta^,  appear  to  be  far  more  limited  in 
their  cipKdty.  They  appear  to  process  only  a  single  item  or  a  small  area  at  one  dme.  The 
basic  idea  of  Guid^  Search  is  that  the  output  cf  the  parallel  processes  can  be  used  to  guide 
the  attentKMial  deployment  ot  the  limited  capaciQr  processes  so  that  this  limited  capacity  is 
used  in  an  effective  manner.  As  one  example,  ctmsider  die  search  fw  an  apple  in  the 
refrigerator.  Even  if  there  is  no  parallel  processor  that  can  discriminate  tomatoes  from 
i^les,  intelligent  use  a  color  processor  can  restrict  processing  to  the  red  items  and  avoid 
wasting  resources  on  the  analysis  broccoli  or  bananas. 

The  Guided  Search  modd  provides  a  detailed  and  testable  description  of  the  deployment  of 
attention  in  human  subjects  doing  visual  search  tasks.  We  have  just  published  the  account 
of  the  second  generadmi  of  the  model  and  its  simulation  [Wolfe,  19^  #2657].  We  show 
that  it  can  sucosssfiilly  simulate  a  wide  range  of  search  b^avicx.  In  this  project,  we  are 
developing  the  third  gaieratkm  of  Guided  Search.  The  original  project  had  three  ^lecific 
aims:  l)Torevise  aid  enhance  the  Guided  Search  simulation  to  haiidle  more  search  tasks 
and  to  produce  mrxe  accurate  simulations  of  human  behavior.  2)  To  study  individual 
differaices  in  seardi  behavior  as  a  source  of  insigjit  into  die  search  mechanism,  and  3)  tt> 
explore  the  possibilities  of  hybrid  search  systems  where  the  interactkxi  of  computer  and 
human  obsr^os  allows  for  better  search  Aan  either  computer  or  human  alone.  We  will 
discuss  progress  in  each  of  these  areas. 

The  Guided  Search  Simulation 

Greg  Gancarz  (a  graduate  student  funded  by  this  project)  has  had  jnrime  responsibility  for 
advancing  the  Guided  Search  (GS)  simuladcm.  Greg  has  completely  rewritten  the  code  for 
the  simulation,  moving  it  from  our  Macintorii  ctxr^uters  to  our  Sun  SparclO.  The 
simulation  now  runs  much  faster  making  it  easier  to  generate  model  predictions.  Another 
addition  has  been  graphical  input  and  ouqiut  The  revised  simulation  allows  more  direct 
contttd  over  die  parameters  in  the  model.  Finally,  the  code  should  be  easily  exportable 
to  other  labs  that  mi^t  want  to  test  the  simulation. 

Tiiming  to  die  scientific  substance  of  the  sunulatkm  project,  most  of  the  details  of  the 
current  simulation  are  as  described  in  Wedfe  (1994).  Thm  have  been  some  interesting 
changes.  For  exanqde,  GS  jm^xises  that  attention  is  guided  by  a  weight^  average  of  the 
ouQMits  oi  the  paraUel  feature  processors.  Those  feature  processes  come  in  two  forms: 
bottnm-pp  processes  diat  guide  attention  toward  loci  of  alxupt  change  and  top-down 
processes  that  giu^  attention  toward  loci  having  a  target  attribute  (the  correct  color  or 
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orientation).  Consider  a  search  for  a  red  vertical  item  among  green  vertical  and  red 
horizontal  distractors.  Since  the  display  is  a  jumble  of  reds  and  greens,  verticals  and 
horizontals,  bottom-up,  local  ctmtrast  information  is  essentially  useless.  Top^iown 
information  is  useful,  however.  The  target  will  be  red,  not  green  and  it  will  be  vertical,  not 
horizontal.  To  woik  efficiently,  attention  should  be  guided  by  the  tq>-down  signals  with 
die  contributions  of  the  bottom-up  sigiuds  minimized.  In  die  puUish^  GS2  simuladon,  the 
weights  are  imposed  by  fiat  In  die  newer  version,  die  sinuilation  learns  the  apprc^jriate 
weights  for  each  task.  To  learn  the  weights,  a  signal  to  noise  ratio  is  computed  for  each 
parallel  feature  repiesentadon  on  each  target-present  trial  The  weights  are  dien  adjusted  up 
or  down  based  on  the  signal  strength.  Weights  are  averaged  over  a  set  (rf*  trials  to  make 
changes  gradual .  We  plan  to  look  in  human  data  for  evi^nce  of  a  similar  weight-adjusting 
mechanic 


Other  changes  are  also  underway.  The  published  simulation  calculates  attention  guiding 
activations  only  at  the  known  loci  ai  items.  In  a  weald  oi  continuous  images  rad^  than 
discrete  items,  this  may  be  an  over-sin^lification.  Acccadingly,  we  are  now  using 
tolerations  that  occur  at  all  locations  whether  or  not  they  contain  stimuli.  For  exanoile,  all 
locations  are  now  subject  to  "noise",  not  only  the  location  ctf  items.  We  have  also  mo^ed 
the  model's  early  viskm  "channels"  for  orientation  and  color  in  an  effort  to  make  them  more 
realistic.  One  aqiect  oi  the  current  reixesentatitMi  of  orientation  has  not  bem  changed  but, 
perfat^s,  should  be.  In  (Hir  experiments  and  in  our  modeling,  we  have  used  simple  lines  as 
our  miented  stimuli  Lines,  rotated  through  180  deg,  return  to  their  original  orientation. 
The  same  is  not  true  for  most  objects.  A  coffee  cup,  rotated  180  deg  has  quite  different 
properties.  We  plan  to  explore  dw  inqilications  of  a  360  deg  orientation  ^ace  in  the  cenning 
year.  In  color,  we  plan  to  move  from  a  very  unrealistic  2D  color  space  to  a  3D  space. 

Individual  Differences  in  Visual  Search 

Patricia  O'Neill,  a  post-doctoral  fellow  in  the  lab,  has  had  primary  responsibility  for  our 
studies  of  individuri  differences  in  visual  search  bdiavior  and  their  relationship  to  the 
Guided  Search.  Our  basic  premise  is  that  individual  differences  are  meaningful  and  are  not 
merely  noise.  Two  erqtotirnents  have  been  run.  Eq}eriment  1  explored  the  reliability  and 
stability  of  individual  differences  observed  in  standi  visual  search  experiments.  We 
tested  30  subjects  on  ei^ht  different  search  tasks:  3  feature  searches  (size,  color  and 
orientation),  3  conjunction  searches  (targ^  ddined  by  a  pairwise  combination  of  the  three 
features)  arid  2  serial  searches  (search  fix’  a  2  among  Ss  with  all  stimuli  upright  or  rotated 
90  deg.)  Set  sizes  of  4, 10  and  16  were  used.  The  dq)endent  measure  is  the  slc^  of  the 
fimetion  relating  reaction  time  (RT)  to  set  size  (SS).  Fex  each  condition,  a  measure  of 
reliability  was  obtained  by  flitting  each  subject's  data  into  even-numbered  and  odd- 
numbered  trials  and  conqruting  an  RTx  Set  Size  slope  for  each  half  of  the  data.  If  the 
sk^)M  are  statistically  r^able,  that  the  slope  derived  fiom  the  even-numbered  trials  ^uld 
be  tire  same,  or  nearly  the  same,  as  the  slc^  derived  fiom  the  odd-numbered  trials. 
Conelating  the  slopes  obtained  fiom  the  even-numbered  trials  with  those  obtained  fixxn  die 
odd-nundwied  trials  indicates  the  degree  reliability  of  each  condition. 

The  reliatnli^  for  the  feature  searches  averaged  0.24  (where  1.0  indicates  perfect  reliability, 
and  0.0  no  reliability).  In  conjunction  searches,  reliability  was  hi^  for  the  blank  (target- 
absent)  trials  (avg.  =  0.87)  but  low  fix  the  target  present  trials  (avg.  =  0.22 )  The  serial 
search  slopes  were  moder^y  reliable,  with  an  average  reliability  of  0.40  fix  the  target 
present  trials,  and  0.80  for  the  target  absent  trials.  P^ormance  across  the  conditicxis 
iq^ieated  to  be  unrelated  (mean  intertask  axrelation  =  0.14). 

The  high  reliabilities  for  blank  trial  slopes  suggests  that  variability  across  subjects  in  tiwse 
conditions  represents  staUe  imlividual  differences.  The  low  relialxlity  of  the  target  present 
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sl^s  means  that,  given  the  parameteni  used  in  this  experiment,  differences  between 
subjects  in  these  tasks  may  be  nothing  but  noise.  Experiment  One  was  designed  to  use  set 

sizes  and  numbers  of  trials  typical  of  those  reported  m  this  literature.  While  the  results 
sugfi^  that  great  caution  should  be  used  in  inteqireting  the  individual  differences  in  the 
piblished  literature,  they  do  not  mean  tl^tlpe  are  no  individual  differences  of  interest  to 
be  found  on  tai^et  present  trials  for  conjunction  and  feature  searches.  Sl^ie  estimates  are 
likely  to  be  quite  unstaUc  when  arehuivdy  small  range  set  sizes  is  used.  A  small  change 

in  the  mean  RT  for  one  set  size  can  produce  a  large  chimge  in  the  slope.  In  an  effort  to 
improve  reliabilities  in  our  data,  we  ran  a  second  experiment 

In  Experiment  Two,  data  were  collected  from  40  subjects  for  anodier  eight  search  tasks. 
There  were  three  conjunction  tasks  (two  Odor  X  Orratation  tasks  and  a  Size  by 
Orientatitm  task).  Thim  were  two  "odd-man-out"  tarics.  In  tfiese  tasks,  subjects  search  for 
an  odd  item  in  a  subset  of  the  elements  cm  the  screen.  For  exanqile,  in  one  of  these  tasks, 
the  target  was  a  red  item  of  orientation  X  deg  and  the  distractors  were  red  items  cd 
orientation  Y  deg  and  green  items  of  orientation  X  deg.  The  orientations,  X  and  Y,  changed 
from  trial  to  trial  so  that  subjects  could  not  know  the  orientatioD  of  the  target  before  the 
trial.  Once  the  stimulus  appeared,  however,  subjects  could  search  for  an  item  of  odd 
orientation  in  the  set  of  r^  items.  These  e)^)eriinents  produce  results  that  are  different  finom 
those  in  a  standard  odor  X  orientation  conjunction  (I%edman-Hill  and  Wolfe,  1994).  In 
the  second  odd-man-out  tasks,  subjects  sauched  for  die  odd  texture  in  the  horizontal  items. 
There  were  two  identification  tasks  in  which  subjects  merely  had  to  name  the  red  letter  or 
the  oblique  letter.  In  these  tasks,  all  diat  was  required  was  that  attention  be  directed  to  aay 
red  or  oWque  letter.  No  odier  search  was  required.  Hnally,  there  was  one  serial  search 
task  for  the  2  among  5s.  Set  sizes  ranged  fitm  27  to  100  for  all  but  the  serial  task,  which 
used  die  typical  set  sizes  of  4, 10  and  16. 

As  in  Experiment  One,  the  reliability  for  die  blank  trials  was  high,  averaging  0.88  across  all 
conditions.  Compared  to  Experiment  One,  die  mean  leliabili^  for  the  target  present  trials 
inqnoved,  increasing  to  0J(X  L^er  set  azesqipear  to  make  die  slope  estimates  more 
stable.  As  a  result,  it  becomes  possilde  to  examine  die  pattern  of  individual  differences. 

The  pattern  of  conrelations  of  the  slopes  over  all  the  conditions  was  examined  with 
strucmral  equation  modeling  (specifically,  Lisrel).  The  object  of  such  modeling  is  to  find 
underiying  factors  diat  might  ei^lain  the  pattern  of  individual  differences  across  tasks.  To 
pve  a  somewhat  trivial  exairgil^  if  die  subject  population  contained  subjects  with  various 
(xdor  vision  deficiencies,  we  wo^  expect  a  factor  related  to  odor  vision  to  eqilain  some 
of  the  varialnlity  on  those  tasks  invcdving  color  but  not  on  the  ocher  tasks.  (In  fact,  all 
subjects  were  screened  for  color  tdindness  and  all  were  in  die  normal  range). 

Tinning  to  a  inore  realistic  examp]^  GS  pic^ioses  that  it  is  die  topHiown  coiiqionent  of  the 
paraM  inocessing  of  basic  feature  iiifonnation  that  is  hnponant  in  guiding  attention  in 
conjunction  search  ta^  and  in  odd-man-out  tasks  but  not,  for  exanmle,  in  seriial  tasks.  We 
aiuuyzed  the  pattern  of  cocielations  across  tasks  to  determine  if  a  model  widi  oooqionents 
derived  from  GS  faired  better  in  accounting  for  die  data  than  models  widi  other 
components. 

Lisiel  aiudysis  indicated  that  die  individual  differences  were  not  due  to  variation  in  some 
single  undm^g^factor  sudi  as  a  motor  sldlls  ability  nor  were  they  explamed  ^  a  modd 
that  proposed  differences  only  in  the  processing  ttf  basic  feature  imormation  (Le.  a  "odor” 
factor,  an  "orientation”  factor,  and  so  on).  A  inodel  based  on  Guided  Search  provided  the 
fit  to  the  data  of  any  model  tested.  It  had  frctocs  for  atientional  draloyment,  topnlown 
activation  for  orientation  and  for  cdor,  a  search  terminatkm  factor,  and  two  task-qredfic 
factors. 
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Hybrid  Search 


The  idea  of  Guided  Search  is  that  the  parallel  stage  ci  visual  processing  can  guide  the 
deployment  of  attention.  The  basic  idM  of  "hybrid  search"  strategies  is  that  ^  ctMnputer  as 
a  partner  in  visual  search  tadcs  providing  addititmal  guidance  to  a  human  searcher.  Given 
our  knowledge  oi  the  human  search  cap^ilides  and  limitations,  we  can  design  artificial 
aids  to  guide  attention  in  a  more  efficient  fashion.  As  a  start  in  this  direction,  Laurent 
Pmthieu  and  I  have  done  a  series  of  p^  ejqieiiments  with  electrical  diagrams.  The  choice 
of  stimuli  is  driven  by  Dr.  Ponthieu's  interests.  He  came  as  a  visitor  from  Electricity  de 
Ruioe,  the  Rench  electric  power  utility.  There,  complex  electrical  diagrams  are  read  by 
technicians  to  troubleshoot  electric  systems.  A  typical  diagram  nodght  be  a  hundred  pages 
long  with  each  page  containing  dozens  of  symbols  and  text  captions.  Diis  seems  like  a 
natural  pli^  to  tiy  hybrid  seai^  since  the  technknan  might  benefit  fiom  the  he4>  of  a 
computer  in  navigating  through  the  diagrams.  We  began  with  two  visual  tasks  that  are  part 
of  reeling  the  diagrams.  The  first  task  was  a  shr^ie  (fmn)  search  for  mie  component 
among  odiers  as  ^ustrated  below. 
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The  target  is  a  "normally  open  relay  contact"  (NORC).  The  distractors  are:  "off-page 
connector"  (AR),  "relay  magnet"  (RM)  and  "normally  ctosed  relay  contact”  (NCRC).  The 
NCRC  coo^xment  is  obviously  the  nxrst  confusable  with  the  target  The  manipulation  in 
this  experiment  was  to  cdcv  c^  different  subconopcxtents.  That  is,  all  of  the  wires  were 
purple,  all  of  the  large  vertical  bars  were  green  and  so  forth.  While  subjects  rqxxted  that 
die  cc^  coded  case  seemed  more  pleasant  it  made  no  significant  difference  to  the  task  as 
shown  in  he  figure  below: 
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S«t  81s* 

Ai^ranently,  subjects  coukl  pick  out  the  contacts  just  as  well  in  the  Mack  and  white 
rendition.  The  search  is  slow,  we  assume,  because  Ss  need  to  make  a  relatively  slow, 
relative  position  judgmott  once  they  have  directed  attention  to  a  large  vertical  bfu*. 

In  the  sectmd  task,  subjects  kK^  for  a  particular  t^n  switch  as  defined  by  its  label.  In  the 
example  given  below,  die  tar^t  is  the  switch  with  a  "1"  in  first  position  in  the  first  row  c€ 
text  and  a  "3"  in  the  third  positicxi  of  the  second  row.  (These  numbers  label  tite  identity  oS  a 
switch  and  give  ccmnection  information.). 
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There  were  three  conditions.  In  the  sltindltzrdcondition,  stimuli  were  rendered  in  Mack  and 
white.  RT  X  set  size  functitxis  had  slc^s  190  msec/ltem  for  target  trials  and  360 
msecAtem  for  Uank  trials.  These  values  suggest  a  scsial  search  with  saccadic  eye 
movements  through  die  set  of  switches.  In  the  colored  condition,  the  relevant  digits  in  the 
text  were  given  a  diffnent  color.  The  resulting  inqxovement  to  170  msec/item  on  target 
trials  and  320  msecfitem  on  blank  trials  is  only  significant  on  die  Uank  trials.  Apparentiy, 
the  time-consuming  pmtion  oi  diis  task  is  the  search  for  the  right  bit  of  text  the 

final,  recoded  condition,  die  rectangular  gra|diic  shown  below  the  text  was  added.  It  is 


shown  in  mne  detail  below: 
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I  104  =  sub-unit  #1, 

contact  #4  contact  #4 

->  second  column  0021JR  =  main  unit  #2 

This  recodes  die  text  Wtxmatioa  in  a  manner  described  in  dte  accoiiq;)anying  technical 
report  For  the  pr^nt  the  impwtant  a^)ect  of  the  recoding  is  that  it  takes  the  reading  task 
and  transforms  it  into  a  search  fiv  a  con^lex  conjunction  ^  basic  features  like  cokx*  and 
slu^.  The  result  was  an  approximate  3-foki  reduction  is  slc^s  to  66  msecAtem  for  target 
trials  and  140  msecAtem  fcK  blank  trials.  These  results  suggests  that  we  may  be  aide  to  add 
symbolic  information  in  the  blank  spaces  oi  the  diagrams  diat  will  guide  search  in  a  useful 
way.  Dr.  Pcmthieu  has  returned  to  I^ce  but  we  plan  to  continue  to  collabcx^te  on  this 
project  His  mcxe  dialled  report  is  included  as  an  appendix. 

Conclusion 

Guided  Search  continues  to  be  a  useful  model  of  visual  search  behavicM*.  It  is  quite  widely 
cited  in  the  attentkni  literature.  In  the  past  year,  I  have  been  invited  to  give  talks  on  Guid^ 
Search  at  the  Human  Factors  meeting  (Se^e,  Oct  '93),  at  a  conference  on  "Converging 
Operations  in  the  Study  of  Visual  Attention  (U.  Illinois,  May  *94),  at  a  conference  on 
"Models  of  SenstHy-Motn-  Comxlination  and  Interactive  Vision"  (Telluride,  CO,  July, 

*94),  as  well  as  at  a  variety  of  colloquium  talks.  We  believe  that  we  are  well  on  the  way  to  a 
3td  generation  of  the  model. 

In  addition  to  Dr.  Ponthieu's  repent,  several  papers  and  preprints  accompany  this  repewt 
They  are: 

Wolfe,  J.  M.  (1994).  Guided  Search  2.0:  A  revised  model  of  visual  search.  Psychonomic 
Bulletin  and  Review,  1(2),  202-238. 

Wedfe,  J.  M.  (1993).  Guided  Search  2.0:  The  Upgrade.  Proc.  of  the  Human  Factors  and 
Ersonomics  Society.  37th  annual  meeting.  1295-1299. 

Wolfe,  J.  M.  (1994).  Extending  Guided  Search:  Why  Guided  Search  needs  a  preattentive 
"item  map".  In  A.  Kramer  (Ed),  Converging  operations  in  the  study  of  visual  selective 
attenticHi.  Washington,  D  C:  American  Psychological  Association.,  in  press 

Wdfe,  J.  M.  (1994).  Visual  search  in  ctmtinuous,  naturalistic  stimuli.  Vision  Research, 
MC9),  1187-1195. 


Wolfe,  J.  M.,  Friedman-Hill,  S.  R.,  A  Bilsky,  A.  B.  (1994).  Parallel  Processing  of 
Part/Vi^te  Information  in  Visual  Search  Ta^s.  Perception  and  Psychophysics,  55(3), 
537-550. 
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